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Abstract.  The  Prowler  IADS  Performance  Evaluator  is  a  computer  simulation  model 
of  an  airstrike  protected  by  electronic  countermeasures  platforms.  It  is  designed  for  integration 
into  mission  planning  systems  and  analysis  tools  used  to  determine  the  effectiveness  of  electronic 
countermeasures  or  allocate  scarce  countermeasures  equipment.  PIPE’S  features  include 

•  flexible  hierarchical  IADS  specification, 

•  the  capability  to  construct  and  calculate  appropriate  measures  of  performance, 

•  graphical  presentation  analysis  results, 

•  mission  visualization. 


1.  INTRODUCTION 

Current  mission  planning  systems  for  strike  aircraft  feature  high  quality  graphical  presentation  of 
geographic  information  in  the  mission  area.  While  effective  in  some  planning  processes,  these  tools 
are  inadequate  for  planning  or  analyzing  the  effects  of  electronic  countermeasures  (ECM).  What  is 
missing  in  these  systems  is  the  capability  to  predict  events  in  time. 

PIPE  evaluates  user-specified  condition  and  event  measures  of  effectiveness  of  ECM  taken  against 
an  integrated  air  defense  system  (IADS).  The  system  models  the  behavior  of  the  IADS  network  using 
a  modification  of  stochastic  timed  Petri  networks,  and  produces  samples  of  the  IADS  time-domain 
behavior.  An  object-oriented  simulation  model  is  used  to  generate  these  samples  by  simulating  the 
interactions  of  the  protected  strike  group,  jamming  assignments,  and  IADS  objects.  IADS  sensors, 
communications  assets,  and  command  structure  are  modeled  using  a  template  structure  populated 
with  data  from  the  Air  Force  Electronic  Warfare  Center  (AFEWC)  Constant  Web  database  [6]. 
The  system  then  allows  ECM  planners  to  allocate  scarce  jamming  resources  while  cognizant  of  the 
impact  of  jamming  assignments  on  the  IADS  performance. 

2.  BACKGROUND 

The  primary  mission  of  the  U.  S.  Navy’s  EA-6B  aircraft  is  to  provide  ECM  to  disguise  or  protect 
other  platforms.  Most  often,  these  protected  platforms  are  tactical  bombers  formed  into  a  strike 
group.  Heretofore,  we  refer  to  the  protected  platforms  collectively  as  the  protected  entity  (PE).  The 
Tactical  EA-6B  Mission  Support  system  (TEAMS)  system  has  been  providing  support  for  EA-6B 
mission  planning  for  nearly  a  decade. 

Soon  after  the  TEAMS  system  was  developed  and  fielded,  mission  planners  realized  a  tremen¬ 
dous  leap  forward  in  Electronic  Countermeasures  Officer  (ECMO)  proficiency,  however  experienced 
ECMOs  still  did  a  great  deal  of  off-line  planning.  Although  the  system  provided  reasonable  presen¬ 
tation  of  the  geographic  relationships  of  locations,  weapon  systems,  and  emitters,  it  failed  to  reflect 
the  organizational  relationship  between  these  entities. 
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The  Advanced  Capability  TEAMS  (ATEAMS)  was  designed,  in  part,  to  correct  this  shortcoming. 
The  design  of  ATEAMS  uses  the  notion  of  parent-child  organizational  relationships  between  IADS 
elements,  as  well  as  emitter  neighborhoods  (groupings  of  IADS  elements  which  share  data,  [7]).  These 
relationships  can  be  displayed  to  the  user,  and  can  be  used  as  input  to  the  mission  planning  process. 
Using  these  relationships  requires  that  the  ECMO  assimilate  graphical  information  about  emitter  and 
weapon  system  relationships,  and  produce  thumbrules  useful  in  allocating  scarce  jamming  resources 
to  threat  emitters. 

It  is  difficult  to  use  the  graphical  display  of  weapon  system  and  emitter  relationships  as  a  jammer 
planning  aid.  The  impact  of  the  relationship  of  a  set  of  emitters  on  the  performance  of  the  IADS  is 
not  explicit  when  presented  in  the  context  of  a  geographical  display.  Furthermore,  the  relationship 
itself  seems  to  have  little  to  do  with  geography  -  the  relationship  affects  reaction  time! 

In  appreciating  the  impact  of  IADS  node  interconnections,  the  mission  planner  must  change 
his  frame-of-mind  from  geographic  to  temporal.  The  purpose  of  ECM  used  by  the  EA-6B  and 
other  platforms  has  less  to  do  with  providing  space  in  which  the  assigned  protected  entity  can  ty 
unmolested,  and  more  to  do  with  delaying  or  controlling  detection  times  of  the  protected  entity.  The 
true  goal  of  ECM  on  the  battlefield  must  be  stated  as  the  control  of  the  battle  timeline. 

Strike  mission  planning  must  evolve  into  a  process  aimed  at  controlling  when  events  occur  on 
the  battlefield.  Often,  ECM  is  used  to  delay  detection  events  to  such  a  degree  that  the  enemy  is 
powerless  to  prevent  the  protected  entity  from  safely  accomplishing  its  mission.  Deception  ECM 
is  designed  to  induce  diversion  of  enemy  resources  from  the  protected  entity.  This  is  accomplished 
by  controlling  what  the  enemy  sees  before  he  detects  the  protected  entity,  so  that  his  reaction  is 
inappropriate.  Analyzing  which  IADS  nodes  perceive  which  threats,  and  when  these  perceptions  are 
made  and  revised,  is  impossible  using  geographically-based  planning  tools. 

A  method  for  examining  and  evaluating  the  time-domain  performance  of  the  IADS  as  the  en¬ 
gagement  evolves  is  required.  Without  such  a  method,  the  value  of  data  about  the  relationships  of 
IADS  nodes  is  minimal. 


3.  MODELING  THE  SYSTEM 

This  section  describes  the  backbone  which  we  use  to  model  the  evolution  of  the  engagement.  This 
model,  first  presented  in  [1]  is  called  the  stochastic  relaxed  Petri  network  (SRPN).  This  model  is  a 
generalization  of  the  stochastic  timed  Petri  network  model  given  in  Haas  and  Shedler  [9],  where  the 
relaxations  are: 

1.  allowance  of  transition  durations  which  are  either  instantaneous,  of  deterministic  length,  or  a 
positive  random  length; 

2.  each  transition  is  allowed  to  happen  in  a  specified  deterministic  time  window,  and  is  prohibited 
from  happening  outside  the  window; 

3.  a  generalized  enabling  condition  structure. 

3.1.  PERT  Networks.  Let  ni,na,...,njv  be  a  set  of  nodes  in  a  network.  Let  two  nodes  be 
joined  by  a  directed  arc  X  which  has  a  natural  tail  and  a  natural  head,  denoted  tail(A’)  and  head(A’). 
In  Petri  nets,  activity  diagrams,  or  PERT  charts,  the  arcs  represent  tasks  and  the  nodes  represent 
milestones. 

The  rules  for  starting  tasks  are:  A  task  X  emanating  from  a  node  n  mag  not  commence  until  all 
of  the  tasks  pointing  info  n  are  complete.  Thus,  the  task  put  shoes  on  cannot  be  started  until  the 
task  put  socks  on  is  completed.  This  simple  rule  dictates  the  time  required  to  complete  the  entire 
task.  When  all  of  the  tasks  pointing  into  a  node  are  complete,  the  node  is  said  to  be  enabled,  and 
all  of  the  tasks  pointing  out  of  that  node  begin  in  parallel. 
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Some  interesting  observations  can  be  made  about  a  process  like  a  PERT  network.  Most  interest¬ 
ing  is  the  fact  that  most  of  the  tasks  in  the  diagram  have  little  effect  on  the  time  of  completion.  There 
exists  a  path  running  through  the  network  which  contains  tasks  whose  completion  times  dominate 
the  time  of  completion  of  the  entire  project.  This  path,  called  the  critical  path,  can  be  identified  by 
looking  at  the  last  arc  which  completes  in  the  network,  then  working  backward. 

We  can  construct  some  very  interesting  structures  within  this  framework.  However,  we  need  to 
slightly  extend  this  system  to  include  structures  which  model  IADS  activity.  This  extension  is  called 
the  Relaxed  Petri  Net. 

3.2.  Relaxation.  The  leap  to  IADS  structures  from  basic  PERT  networks  is  intuitive.  Instead 
of  the  tasks  relating  to  the  donning  of  a  particular  piece  of  clothing,  they  will  be  detection,  com¬ 
munications,  and  decision  tasks.  These  also  take  time  to  complete,  and  have  a  precedence  structure 
similar  to  the  one  just  described.  However,  in  the  IADS  structures  we  will  construct,  there  will 
usually  be  redundant  sources  of  information,  redundant  communications,  several  decision  makers, 
and  several  data  fusion  nodes.  Hence,  we  need  to  be  a  little  less  strict  about  the  conditions  under 
which  a  task  can  begin. 

We  wish  to  relax  the  requirement  that  all  of  the  tasks  pointing  into  the  tail  of  a  task  must  be 
completed  before  the  task  can  start.  Suppose  instead  that  each  node  in  the  structure  has  two  sets 
of  tasks  pointing  into  it: 

•  the  essential  ones  -  these  MUST  be  completed  before  the  outpointing  tasks  can  commence; 

•  the  nonessential  ones  -  those  which  are  redundant  and  are  all  of  equal  value. 

We  shall  denote  the  essential  tasks  for  node  n  as  En  and  the  nonessential  tasks  for  node  n  as 
E We  will  also  allow  the  node  to  specify  how  many  of  the  nonessential  arcs  need  to  be  completed 
before  the  outpointing  tasks  can  commence.  This  number,  denoted  kn,  will  be  specified  for  each 
node. 

As  we  can  see  from  the  Figure  1,  only  two  things  are  really  going  to  be  required  before  the  TA 
detection  task  can  begin 

•  the  command  to  allow  the  TA  search  to  begin  must  be  given; 

•  there  must  be  some  sort  of  early  warning  message  passed  to  the  emitter. 

Obviously,  this  structure  is  not  appropriate  for  every  IADS,  but  it  serves  as  a  good  example. 

The  tasks  associated  with  the  EW  data  are  nonessential  -  we  only  need  one  EW  data  que  to 
begin  the  TA  detection  task.  However,  we  do  require  that  there  be  a  command  given  to  allow  us  to 
start  the  detection  process.  Hence,  the  tasks  a,6,c=  En,  d  =  E'n,  and  k„  =  1. 

3.3.  Hierarchical  Construction.  To  make  PIPE  viable  in  a  mission  planning  system,  there 
needs  to  be  a  hierarchical  system  for  constructing  IADS  SRPNs.  The  network  we  have  described  so 
far  is  constructed  of  arcs  and  nodes.  If  we  were  to  construct  the  entire  IADS  SRPN  with  these  simple 
objects,  we  would  produce  a  structure  which  was  not  recognizable  or  usable  by  mission  planners. 

What  is  required  to  improve  this  situation  is  a  way  to  describe  and  design  the  IADS  SRPN  using 
templates,  well-understood  low  level  models  of  specific  network  pieces,  and  a  language  for  linking 
simple  pieces  together  to  make  more  complex  IADS  structure  which  we  can  analyze.  We  will  do  this 
by  describing  the  system  in  terms  of  Networks,  Subnets,  and  Simple  Arcs.  We  will  describe  these 
objects  from  the  simplest  to  the  most  complex. 
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Sources  of  EW 


Figure  1:  Fragment  of  an  IADS  SRPN.  EW  data  sources  are  redundant,  only  one  data  source  is 
required  to  begin  the  task  T4  Detection. 


Simple  Arcs.  Simple  arcs  correspond  to  detection,  data  fusion,  decision,  and  communications 
activities  -  these  are  the  tasks  described  in  the  previous  sections.  A  simple  arc  is  always  tied  to  a 
specific  geographic  location,  and  may  be  an  ECM  target.  Simple  arcs  can  be  knitted  together  to 
make  more  sophisticated  structures  called  subnets.  The  relationship  between  a  simple  are  and  the 
evolution  of  the  engagement  comes  from  its  location  (geographical  and  structural)  and  its  stand-alone 
performance  characteristics,  like  its  range  and  speed  of  execution. 

%  Subnets.  Subnet  objects  are  template-like  specifications  of  network  fragments.  Subnets  are 
constructed  of  simple  arcs,  or  of  other  subnets,  plus  the  required  nodes.  In  fact  simple  arcs  are 
objects  derived  from  subnet  objects.  Each  subnet  has 

1.  a  set  of  nodes  which  are  sources  for  the  subnet; 

2.  a  set  of  nodes  which  form  the  ends  of  the  subnet; 

3.  a  set  of  interior  nodes; 

4.  a  set  of  subnets  which  connect  one  interior  node  to  another. 

Simple  arcs  are  considered  subnets  with  no  interior  nodes. 

Networks.  For  ease  of  construction,  we  will  insist  that  every  subnet  data  set  have  one  subnet 
called  IADS.  When  the  IADS  is  retrieved  from  the  subnet  data,  the  system  will  then  instantiate 
the  IADS  and  look  for  all  the  interior  subnets  called  for  in  the  IADS  specification.  This  iterative 
expansion  of  subnets  continues  until  the  IADS  is  complete. 
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Example.  We  have  constructed  a  set  of  subnets  which  allow  us  to  expose  the  richness  of  the 
structure  we  use.  Lets  establish  some  terminology,  and  to  show  the  data  set  required  to  instantiate 
this  simple  system.  The  example  network  is  constructed  to  be  a  torture  test  for  our  subnet  paradigm. 
It  has  more  complexity  and  depth  than  any  real  system.  It  has  the  required  IADS  subnet,  containing 
one  internal  subnet  called  network  1.  The  subnet  network  1  takes  some  simple  Arc  l’s  and  Arc  2’s 
to  connect  to  parallel  subnets  both  of  type  system  1.  System  1  is,  in  turn,  comprised  of  a  simple  arc, 
Arc  5,  and  two  types  of  subsystems,  subsysl  and  subsys2.  Each  of  these  subsystems  are  comprised 
of  simple  arcs,  called  Arc  i.  Figure  2  shows  the  hierarchy  of  subnets  used  for  this  example.  The 
specification  of  En,  E'n  and  kn  for  each  node  n  is  difficult  to  show  in  a  diagram,  but  resides  in  the 
appropriate  data  for  the  network. 

Our  example  network  has  over  210  simple  arcs  connected  together.  When  PIPE  reads  the 
appropriate  files  and  constructs  the  IADS,  it  uses  each  of  these  templates  in  an  iterative  manner. 

The  true  power  of  the  subnet  structure  is  seen  when  we  attempt  to  modify  the  structure  of  the 
example.  Suppose  that  we  had  a  different  subsys  1  structure  which  we  just  learned  about.  Let’s 
call  this  new  subsysl  subsys  la.  If  we  change  the  specification  of  system  1  in  the  three  instances  of 
subsys  1,  replacing  each  with  a  subsys  la,  and  then  enter  subsys  la’s  structure  in  the  subnet  data 
file,  we  have  accomplished  the  switch. 

Of  keen  interest  might  be  the  use  of  this  capability  to  inherit  and  modify,  as  we  do  in  object- 
oriented  programming.  In  this  vane,  suppose  subsys  1  actually  had  an  arc  which  emanated  from 
node  ss4  to  some  new  node  ss5.  We  could  accomplish  this  alteration  by  making  subsys  la  a  two- 
subnet  system  with  one  interior  node.  One  of  the  arcs  in  subsys  la  would  be  of  type  subsysl,  and 
the  other  would  represent  the  new  arc.  The  single  interior  node  of  subsys  la  would  take  the  place 
of  ss4. 


3.4.  Timing  the  Engagement.  PIPE  models  the  PE  as  a  single  point  mass  which  travels 
through  the  engagement  area.  Based  on  an  emitter’s  maximum  range,  the  detection  task  associated 
with  an  emitter  cannot  commence  until: 

•  the  PE  is  within  the  maximum  range  of  the  emitter; 

•  all  of  the  structural  SRPN  requirements  are  met. 

A  task  is  terminated  when  either  of  these  requirements  is  no  longer  met,  either  the  PE  goes 
out  of  range,  or  some  other  IADS  element  which  was  supporting  the  detection  process  goes  away. 
Communications  assets  are  restricted  only  be  the  structural  constraints.  Detection  tasks  which  are 
complete  (the  radar  is  locked  onto  the  PE)  remain  unaltered  until  the  PE  exits  the  maximum  range. 
Thus,  each  task  in  the  IADS  is  limited  to  a  time  window  in  which  it  can  be  completed,  where  the 
window  is  determined  by  movement  of  the  PE. 

The  jamming  aircraft  are  similarly  modeled  as  moving  point  masses,  but  they  have  the  ability 
to  employ  ECM  against  emitters  in  the  IADS.  Jammer  effects  are  modeled  by  two  means: 

•  range  ring  reduction  for  detection  tasks; 

•  speed  degradation  for  any  vulnerable  task. 

Each  jamming  modulation/emitter  pair  has  a  set  of  degradation  data  used  in  the  model. 
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Figure  2:  Example  Network  Structure  which  Challenges  the  Ability  of  the  Subnet  Paradigm  to  the 
Fullest. 
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Mission  Visualization.  The  navigation  of  the  PE  and  jammers  is  modeled  using  the  object- 
oriented  toolbox  called  the  Platform  Foundation  [2].  This  tool  also  provides  an  animation  of  the 
mission  using  a  map  of  the  mission  area,  moving  icons  representing  platforms,  and  multicolored 
range  rings  to  show  the  status  of  an  emitter.  This  technology  provides  a  crude  but  effective  mission 
rehearsal  and  analysis  capability,  but  the  users  of  PIPE  are  cognizant  of  the  shortcomings  of  watching 
the  animation  of  a  small  set  of  replications  using  an  animation. 

4.  MEASURING  EFFECTIVENESS  OF  THE  IADS 
In  this  section,  we  discuss  the  construction  of  measures  of  effectiveness  (MOEs)  for  the  IADS  during 
an  analyzed  mission.  Before  proceeding,  we  must  explicitly  acknowledge  the  importance  of  MOEs 
in  the  strike  mission  planning  process.  Ultimately,  the  IADS  is  designed  to  destroy  aircraft  as  they 
travel  toward  the  target,  so  as  to  prevent  the  aircraft  from  destroying  the  target.  The  strike  group 
seeks  to  overcome  this  protection.  Here  we  describe  events  and  conditions  which  indicate  whether 
the  IADS  succeeds,  hence  the  degree  to  which  the  IADS  is  defeated. 

In  our  model  of  the  IADS  performance,  we  stop  short  of  calculating  the  distribution  of  the 
number  of  missiles  fired  at  the  strike  group  because  we  profess  to  know  little  about  the  weapons 
employment  of  the  enemy  in  any  particular  scenario.  Instead,  we  will  calculate  the  distribution  of 
several  events  and  conditions  which  are  strong  indicators  of  the  lethal  threat  posed  by  the  IADS.  In 
what  follows,  we  describe  a  flexible  way  for  the  user  to  design  their  own  MOE,  and  give  suggested 
standard  measures. 

4.1.  Condition  and  Event  MOEs.  There  are  two  basic  categories  for  measures  of  IADS  ef¬ 
fectiveness,  these  being 

•  the  first  time  a  specified  event  occurs,  and 

•  the  mission  time  during  which  a  condition  exists. 

Examples  of  the  former  class  are  the  time  until  a  specified  neighborhood  can  track  the  PE  with 
target  acquisition  radar,  the  time  that  any  target  tracking  radar  tracks  the  target,  or  the  time  at 
which  an  early  warning  broadcast  is  issued.  The  latter  class  contains  MOEs  such  as  the  time  in  the 
mission  when  the  strike  group  is  tracked  by  a  specified  set  of  target  tracking  radars,  or  the  length 
of  time  that  the  target  acquisition  solution  remains  current.  We  will  heretofore  refer  to  the  former 
class  as  event  MOEs  and  the  latter  as  condition  MOEs. 

For  an  event  of  interest,  e.g.  the  time  the  first  target  tracking  radar  in  the  IADS  locks  onto 
the  PE,  let  E  be  a  random  variable  representing  the  time  the  event  occurs.  We  will  estimate  the 
cumulative  probability  distribution  function  Fb,  which  is  defined  as 

Ffi(f)  =  P[the  event  occurs  before  <]  (1) 

=  P[E<t).  (2) 

The  associated  probability  density  function,  /g(t)  =  6FE(t)/6t  gives  us  the  rate  of  occurrence  of  E 
over  any  time  interval.  Thus,  if  E  is  the  time  that  the  first  target  tracking  radar  locks  on,  then  Fe(t) 
tells  us  the  likelihood  that  lock  on  occurs  at  time  t  or  before,  and  /e(<)  gives  us  relative  measures 
of  the  times  that  E  is  likely  to  occur. 

Let  ei.ej, . .  .,em  be  a  set  of  observations  of  E  generated  from  independent  simulation  replicar 
tions.  We  wish  to  construct  our  best-guess  estimate  of  Fc(t).  This  guess  is  denoted  Fb,  end  can  be 
constructed  via  a  histogram  of  the  outcomes  e,-  as  follows.  Suppose  that  we  have  a  histogram  with 
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k  evenly  spaced  cells  between  some  lower  and  upper  bounds  Le  and  Ue,  each  cell  being  exactly 
w  —  Ux^Jlx.  wi<je.  We  tabulate  the  Cj.i  =  1, 2, . . . , n  samples  in  the  cells  so  that 


/,•  =  [number  of  ei  in(L,E  +  (»  —  1)w,Le  +  no)].  (3) 

Thus,  /,-,i  =  1,2, ...  ,k  is  a  rough  estimate  of  the  probability  density  of  E  in  (Le  +  (i  —  l)u>,  Le  + 
iw).  We  can  then  construct  the  empirical  probability  distribution  function  Fe  using 


Fe{x)  = 


m*<tr+(m+IV 


(*  -  (Lb  -f  mic) 


The  first  term  is  obviously  the  relative  mass  of  observations  of  e<  which  fall  in  cells  completely  below 
at,  while  the  second  term  is  the  linear  interpolation  of  /  in  the  cell  to  which  x  belongs.  This  method 
is  extremely  common  and  is  explained  fully  in  [5]. 

For  condition  MOE  C,  we  define  the  function 


pc( 0  =  P[C  persists  at  time  t].  (5) 

This  function  is  not  a  probability  density  function  in  t,  but  shows  the  likelihood  that  condition  C 
persists  at  a  point  in  time.  By  integrating  pc(t)  over  [0,  T], 

Pc(T)=  [Tp(t)dt  (6) 

Jo 

we  can  derive  a  function  which  shows  accumulated  exposure  to  a  condition  over  the  length  of  the 
mission  timeline. 

For  any  condition  MOE,  the  stretch  of  time  that  the  condition  persists  is  recorded  on  a  histogram- 
like  object,  one  count  of  frequency  is  added  to  each  time  interval  that  the  node  was  enabled.  When 
the  histogram  is  presented,  the  profile  presented  is  the  probability  that  the  condition  was  true  in 
each  time  interval: 


number  of  times  condition  true  at  t 
number  of  replications 
P[condition  true  at  <]. 


(7) 

(8) 


4.2.  MOE  Nodes.  We  can  use  some  extra  nodes  in  the  network  to  facilitate  the  collection  of 
MOEs.  These  special  nodes  are  called  MOEXodeObjs,  and  have  extra  capabilities  beyond  those  of 
run-of-the-mill  lodeObjs.  Whether  an  MOE  node  is  an  event  node  or  a  condition  node,  it  needs  to 
be  integrated  into  the  IADS  SRPN.  Ail  MOEs  can  be  calculated  once  we  know  the  time  that  all  of 
the  nodes  (milestones)  in  the  IADS  SRPN  are  enabled.  In  the  examples  above,  the  MOE  is  attached 
to  IADS  SRPN  nodes  as  follows: 


•  EVENT:  IADS-wide  TT  LOCK-ON:  enabled  when  the  first  TT  lock-on  node  is  enabled  any¬ 
where  in  the  IADS; 

•  CONDITION:  Neighborhood  1  TA  SOLUTION:  enabled  as  long  as  the  neighborhood’s  TA 
data  fusion  element  is  actively  supporting  the  neighborhood. 

We  can  get  this  information  for  free  by  adding  nodes  (MOE  nodes),  connected  with  zero-duration 
Facilitator  arcs  to  the  nodes  which  comprise  the  MOE.  This  is  possible  by  using  objects  which 
make  it  easy  to  snatch-up  groups  of  nodes  and  connect  them  to  the  MOE  nodes  after  the  rest  of  the 
IADS  is  constructed.  Using  zero-length  tasks  is  a  standard  PERT  network  technique,  see  [13]. 
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CntkaMy  men 


Figure  3:  Criticality  Indices  for  some  Tasks  in  an  Example  Network  Relative  to  the  MOE  EVEHT: 
I ADS- side  Engagement  Phase  Begins 


4.3.  Off-The-Shelf  Measures.  The  flexibility  afforded  by  the  MOE  nodes  and  bundles  enables 
the  user  of  PIPE  to  monitor  any  identifiable  event  or  condition.  For  ease  of  use,  there  are  a  selection 
of  standard  event  and  condition  MOEs  available  for  evaluation  in  the  analysis  or  planning  process, 
as  well  as  the  capability  to  examine  the  performance  of  user-specified  IADS  nodes. 

The  standard  MOEs  are  constructed  by  considering  the  phases  of  the  engagement,  early  warning, 
target  acquisition,  and  engagement.  We  wish  to  get  the  information  about  events  indicating  the 
transition  from  one  phase  to  the  next,  as  well  as  the  condition  that  the  engagement  is  in  a  given  phase. 
Finally,  we  want  this  information  for  the  entire  IADS,  for  each  data-sharing  emitter  neighborhood, 
and  for  each  individual  detection  or  communications  emitter.  After  an  IADS  is  constructed,  MOE 
nodes  and  bundles  are  added  for  all  of  these  measures  automatically.  When  the  model  is  run  for  m 
replications,  /  and  p  are  automatically  constructed. 

5.  NETWORK  ANALYSIS 

5.1.  Criticality.  Let  n  be  a  MOE  node.  Every  time  that  we  sample  a  replication  of  the  SRPN 
performance,  we  can  perform  the  backward  chaining,  starting  at  n,  to  determine  the  tasks  which 
contributed  directly  to  the  time  n  was  enabled.  Since  each  of  these  replications  are  statistically 
independent,  it  is  likely  that  the  tasks  which  are  on  the  critical  path  to  n  will  be  different  in  each 
replication. 

Let 

cx  —  P[fasfc  X  it  critical].  (9) 

cx  is  called  the  criticality  of  task  X  with  respect  to  milestone  n.  We  can  measure  the  importance  of 
any  task  X  to  the  accomplishment  of  milestone  n  using  c*  -  if  we  interfere  with  the  speed  at  which 
X  is  performed,  we  can  expect  to  interfere  with  the  accomplishment  of  milestone  n  with  probability 
cx-  Calculating  the  criticality  of  a  task  is  a  straightforward  affair,  it  is  efficient,  and  can  be  done 
without  any  specific  ideas  about  how  we  wish  to  alter  the  jamming  plan  or  other  factors. 

We  should  point  out  that  the  criticality  indices  of  each  task  depend  on  the  choice  of  n.  Thus,  we 
need  to  choose  a  central  MOE  for  criticality  analysis  before  replications  are  done.  Furthermore,  if  n 
is  an  MOE  likeEVEIT:  IADS-side  Engagement  Phase  Begins,  all  of  the  tasks  which  are  important 


The  Prowler  IADS 


Performance  Evaluation  Tool 


(PIPE) 


10 


Figure  4:  Frequency  Plot  for  Juice  for  the  MOE  EVENT:  IADS-wide  Engagement  Phase  Begins 
for  two  alternative  Jammer  Gameplans.  The  calculations  show  d  =  2.20,  with  a  95%  confidence 
interval  of  (1.98,2.41)  based  on  53  replications.  Clearly,  51  is  inferior  to  52,  because  the  difference 
is  significantly  positive.  Time  units  are  in  minutes. 


to  n  will  have  high  criticality  indices.  This  includes  tasks  which  are  EW  and  TA  detections  and 
communications.  Hence,  we  can  use  criticality  indices  for  engagement  phase  transition  to  target 
emitters  used  in  all  of  the  phases  of  the  engagement. 

Let  6x  be  an  indicator  variable 


X  is  on  the  critical  path 
otherwise. 


Then  we  can  estimate  the  criticality  of  X  as 


(10) 


SkM*>, 

» 


(ii) 


cx  is  simply  the  proportion  of  the  replications  which  observed  X  as  critical  to  n. 

The  shortcoming  of  using  criticality  measures  to  guide  decisions  concerning  jammer  management 
is  that  the  yield  in  terms  of  delaying  n  is  not  stated,  only  that  there  will  be  some  yield.  Cx  is  an 
instantaneous  yield  estimate,  in  that  the  expected  time  »  occurs  will  increase  exit  if  we  increase 
the  time  X  takes  to  complete  by  6t,  given  that  6t  is  iufinitesimally  small. 


5.2.  Juice.  Let  n  be  an  MOE  we  are  interesting  in  controlling  using  jamming  assignments  and 
other  actions.  Let  Si  and  Sj  be  two  collections  of  jamming  assignments  (these  may  also  include 
other  actions  like  route  alterations,  HARM  missile  employments,  or  strike  package  composition). 
The  question  we  wish  to  answer  is,  "What  is  the  effect  of  changing  from  Si  to  Sj  on  the  time  n 
occurs?"  We  replace  this  formal  question  with  the  slang,  "How  much  juice  is  in  the  altered  jammer 
management  plan  5j?"  This  is  particularly  appropriate  if  Si  and  5j  differ  in  only  one  assignment, 
say  against  task  X  associated  with  a  target  emitter.  In  this  case,  we  are  seeking  the  juiciness  of 
adding  the  assignment  against  X. 

To  estimate  this  quantity,  we  collect  m  replications  of  the  SRPN  performance  under  each  of  the 
sets  of  conditions  5i  and  5a,  and  pair  the  samples  as  (e* ,  ef),  i  =  1, 2, ....  m.  Let  d,  be  the  difference 
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within  pair  i, 

d,  =  e]  -  ej.  (12) 

The  collection  of  sample  differences  d,,  i  =  1, 2, . . . ,  m  is  comprised  of  independent  samples,  and  is 
amenable  to  constructing  empirical  distribution  functions  and  sample  moments. 

6.  THE  MISSION  PLANNING  PROCESS  USING  PIPE 
We  have  described  a  set  of  capabilities  useful  to  the  ECM  mission  planner,  but  need  to  describe 
their  use  in  the  planning  process.  The  mission  planning  process  in  this  domain  is  limited  to  select¬ 
ing  targets  for  ECM,  choosing  ECM  transmitters  for  the  mission,  and  choosing  a  preprogrammed 
reaction  to  detection  of  threat  signals  by  the  ECM  aircraft  or  the  PE.  Collectively,  we  call  these 
decisions  the  jammer  gameplan.  Our  goal  is  to  use  the  information  provided  by  PIPE  to  improve 
the  gameplan. 

We  start  the  PIPE  planning  support  with  the  following  in  hand: 

•  a  current  gameplan; 

•  PE  route; 

•  all  of  the  automatically  generated  MOE  and  criticality  data  for  the  current  gameplan. 

Our  highest  priority  in  mission  planning  is  to  counter  lethal  threats  to  the  PE.  Thus,  standard 
measure  EVEIT:  IADS-uid*  Engagement  Phase  Begins  is  the  initial  key  for  planning  purposes. 
We  wish  to  delay  this  event  as  much  as  possible,  and  raise  the  probability  that  it  doesn’t  occur  at 
all. 

We  will  use  an  established  sequence  to  improve  our  gameplan: 

1.  ASSESS:  Determine  how  well  we  do  with  the  current  gameplan  -  use  the  mission  visualization 
tools  and  IADS  engagement  phase  event  and  condition  MOE  displays. 

2.  SEARCH:  Determine  which  elements  in  the  IADS  are  good  candidates  for  jammer  targets  - 
use  criticality  indices  for  each  task,  neighborhood  and  platform  MOEs,  and  visualization. 

3.  EXPERIMENT:  Determine  the  effect  of  attacking  some  subset  of  the  candidate  targets  - 
calculate  and  tabulate  assignment  juice  for  each  choice 

4.  REASSIGN:  Adopt  a  superior  subset  of  the  candidate  targets  into  the  current  gameplan. 

By  looking  at  a  graph  like  Figure  5,  we  get  an  initial  feel  for  the  efficacy  of  the  current  gameplan. 
Our  goal  is  to  move  the  hump  in  the  event  graph  to  the  right,  delaying  the  onset  of  the  lethal 
phase  of  the  engagement.  We  wish  to  press  the  condition  graph  down  and  to  the  right.  Recall 
EVEIT:  IADS-wids  Engagement  Phase  Begins  can  be  used  to  target  tasks  which  are  EW  and  TA 
detections  and  cr-  munications. 

After  iteratii  v  through  the  sequence  a  number  of  times,  the  planner  should  reach  a  point  of 
diminishing  returns  in  juice  for  any  assignment  or  gameplan  alteration.  At  that  point,  the  planner 
can  repeat  the  process  for  EVEIT:  IADS-wide  Acquisition  Phase  Begins.  This  should  be  done 
only  under  the  constraint  that  no  assignment  used  to  counter  engagement  MOEs  be  dropped. 
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Figure  5:  Probability  Plot  for  Event  and  Condition  MOE  Estimates  for  Neighborhood  2:  Target 
Acquisition 


Figure  6:  Probability  Plot  for  Event  and  Condition  MOE  Estimates  for  Neighborhood  2:  Target 
Acquisition  after  Some  Action  is  Taken  to  Counter  Target  Acquisition. 
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7.  CONCLUSION 

PIPE  is  a  powerful  tool  to  analyze  the  performance  of  an  ECM  mission  gameplan.  This  analysis  is 
conducted  by 

•  simulating  the  engagement  of  the  EA-6B’s,  the  IADS,  and  the  PE; 

•  measuring  the  performance  of  the  IADS  in  a  way  useful  to  the  ECM  mission  planner; 

•  identifying  likely  jammer  targets  for  enhancing  the  gameplan; 

•  facilitating  direct  comparisons  between  gameplans  so  that  superior  gameplans  can  be  identified. 

PIPE  does  not  isolate  jammer  targets  without  the  experienced  hand  of  the  ECMO,  but  it  allows 
the  ECMO  to  experiment  with  the  gameplan  before  encountering  the  IADS  in  person.  PIPE  allows 
a  limited  mission  rehearsal,  and  provides  graphical  demonstration  of  the  value  of  ECM  in  the  strike 
mission. 
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GUIDE  TO  NOTATION 


AFEWC 

Air  Force  Electronic  Warfare  Center 

E 

time  an  event  of  interest  occurs 

En(E'n) 

Essential  (nonessential) 
tasks  pointing  into  a  node  n 

ECM 

Electronic  Countermeasures, 
jamming  radar  or  communication 
transmissions 

EW 

Early  Warning 

*» 

number  of  nonessential  tasks 
pointing  into  node  n  before  it  is 
enabled 

IADS 

Integrated  Air  Defense  System, 
a  network  of  sensors,  command, 
control,  and  communications  assets 
designed  to  protest  an  area  from 
bombing  by  strike  aircraft 

Le,Ub 

bounds  on  the  tabulation  of 
empirical  density  for  event  E 

MOE 

Measure  of  Effectiveness 

MG 

Missle  Guidence 

ni,n2,...,njy 

node  set  for  a  network  model 

PE 

Protected  Entity,  the  strike  group 

PERT 

Project  Evaluation  and  Review 
Technique,  methodology  for  project 
milestone  planning 

PIPE 

Prowler  IADS  Performance 

Evaluator  analysis  software 

SRPN 

Stochastic  Relaxed  Timed  Petri  Net 

TA 

Target  Acquisition 

TEAMS 

The  Tactical  EA-6B  Mission  Support 
System,  mission  planning  computer 
system  for  ECM  aircraft 

TT 

Target  Tracking 

X 

task  in  a  PERT  network  or  SRPN 
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